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ARRANGEMENT FOR PREDI' 




JG ANABN.ORMA-MTY OF A 

THE 




STEM 



DRMALITY 

The invention is directed to an arrangement for predicting an abnormaJity 
of a system and for the implementation of an action opposiiig the abnormality. 

The detemunation or an information flow o^a system is known from 
.andMriah^^ h ' ^^^^^^ "f^f^an^^S 

The information floWVharacterizes a loss of information in a dynamic 
system and describes decaying statistical depenflencies between the entire past and a 
point in time that Ues p steps in the future as a function of p. Among other things, the 
utility of^^^nformation flow is Geffiprisp-^rein that a dynamic behavior of a 
complex system can be classified , -4hi 3 I fe adifi^there 



a4ii4g-thereto4hata suitable parameterized 
model i^ found that enables a modeling of data of the complex dynamic system. 



A neural network and^he training of a neural network are known fromjjsf:^^ 



' The object of the 



ffvention is e^^^^&^2n^peeifying-an arrangement that, 
enables a prediction of an abnormality of a system anaimplements an action 



opposing the abnormality/. 



a€cofdingixi-th'e^eatures-of^patentxldm"l"'^?V^ ^ 



An arrangement for predicting an abnormality of a system and for 
implementing action opposing the abnormality is inventively recited.,^ measured 



data pick 
processor 



up/ 



(1) 
(2) 

(3) 



=the£eirtthat determines measured data of the system. A 
S"^8Mgured-such-that-the following steps ^e^n^^t ^aeo ted* 

a neural network is trained on the basis of the measured data; 
the information flow of the system is ^mp l o y ed -in-ofder to make a 
prediction about anticipated measured data; 
when the prediction indicates that the abnormality of the system is 



anticipated^ the action is implemented; 



^Jaff actuator that implements the action is^ 
application. 



^nl^on the respective 



A goal of the m?Oention is a'^ystematic approach to the general proMern-aftd^ 
Alzra-sointte n of thi s gen c rm p rebtem^ieiwed4herefrQm— the^et^F^^ 

(referred to below as prediction quantitvj that is suitable for predicting djoaamic events 
of a system. The early recognition of a pattern that represents an-att^feCTra "normal" 
behavior of tKe system is of great significance, as, among other things, the following 
applied e^Miples document. / 
The applied strategy is divided into three steps: / 

1 . The dynamically characterizing features of the4ystem are extracted and 
adaptively learned (trained). The measureior learning the dynamics of the 
system in this dynamic learning phase should ftdequately-geneFaPtn-or-der to 
correspond to stationary as well as ndn-stationary conditions. The 
dynamic learning phase is also used in order to demarcate a normal 
condition of the system from an abnormal condition (abnormality). 

2. At least one variable (predktion quantity) is determined with which the 
abnormality is successflJly described. 

3. As soon as an occurrence of the abnormality is indicated, the information 
of the impending afemormality is used in order to oppose the impending 
abnormality via/n actuator whose job is to restore the dynamic system into 
the normal condition. - It is thcrcb y-t-e-be'taken-into-consider-a^en that the 
normal condition is subject to a natural modification over the course of 
time, 'tte^%em^ taken into consideration by adaption, i.e^ contmued traimng 
of theoieural netjwork/ even after the learning phase. 

One development-i^efl^i4sed4he!^iH4-nawiie-steps (2) and (3) of the 
processor umt-fo*Bci-aii-entltess4eep. , , 

/ Another development of the invention is comprised ^tfaefeigthat the 
predetermined abnormality is an information flow with a dynamic?below a prescribable 
threshold. In this case, the action can be ^cSSiprfp o <j in supplying the system with noise. 
It is/possible to deliver^^L^^as^ on the basis of a corresponding electrical field or a 
corresponding magnetic field. Both the electrir^al field as well as the magnetic field can 
ycfeefeby be supplied to the system on th o- bas is-orat least one electrode. 
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An additional improvement -is ounipiised therem-that-the predetenpined 
abnormality is an information flow having a dynamic'kbove a predeterminecrthreshold. 
ReaGtion - tb ecete-eaB-be-sncfa-tha^-the-s yst o m is -exeited-^ith-a-^^gulaj-^ignalr-^his^ 
ensue -airt ho biujia of o n electrical or magnetic field. The electrical fiela and/or the 
magnetic field can be respectively supplied to the system on the b^s of at least one 
electrode. 

In the framework of another development, it is 0o possible to utilize an 
electrical and a magnetic field in combination in order to /(ppose the abnormality. 



e4flvention-also-deiive;^0m4he-dependent=daimsr 



the invention are presented in greater detail on 



Exemplary embodiments of 
the basis of the following Figures. 

Shown arc: , 
Figure 1 ^ an arrangement for predicting>an abnormality of a system and for 

implementing an action opposing the abnormality; 
Figure 2 an actuator AKT2^iacjive component, composed of a computer R, an 

interface DF, an energy store BT and two electrodes ELI and EL2; 
Figure 3 ^ s'^ps'ofa^ fbe>implementation on a processor unit. 

^ ^ ^ ^ Figure 1 shpws^an arrangement for predicting an abnormality of a system 
and for implementing ape action opposing the abnormality. 

The measured data pick-up MDA registers measured data of a system S. 
To this end, the n>easured data pick-up MDA is preferably arranged within the system 
S in order to ro^ister the measured data on site. The measured data are conducted to a 
processor umt PRE -ftRQ-pFoeessed-t-hef eat*. The processor umt PRE preferably 
comprises/a neural network NN that, following training, suitably interprets further 
measur^ data registered by the measured data pick-up MDA. When there are 
indications that an action is to be implemented due to the measured data, an actuator 

IT is initiated by the processor unit PRE to implement a predetermined action. The 
p&tuator preferably comprises at least one electrode that is directly driven by the 
processor unit PRE. 



/ 



# 



t.el it Uieieby bc - n o ted r tJUatilb e^processor unit is arranged in the sys^m S\ 
as indicated in Figure 1 on the basis of the broken line and the appertaining ^signation 
of the system S\ 

The system S preferably comprises the measured data pick-^dp MDA and/or 
the actuator AKT in order to respectively assure a direct access of me measured data 
pick-up MDA to the measured data and of the actuator AKT to me system. 

Figure 2 shows a differently constructed actuator AKT 2. \%4he-interfaee ^ 
•^ Ol^lnia -actuator AKT2 likewise receives a signal from the Processor unit PREfthat 
informs a computer R, which is part of the actuator AKTZ, that a predetermined action 



10 is to be implemented. Wumior, - an energy store BT is provided in the actuator AKT2;^ ^ 
-ftfiis^nergy store BT, controlled by the computer R ^pplymg - energy to the electrodes 
ELI and EL2 in a suitable way. The computer R/of the actuator AKT2 th^eby 
controls the interface IF in order to preferably/fletermine amplitude and frequency of 
the energy applied to the electrodes ELI and EL2. 

15 Figure 3 shows steps of the ^ethod implemented by the processor unit 

PRE. 

^^^^^ ^^eural network NN ii^rained in a step 30 L To this end, measured'ciata 

of a suitable scot>^are prescribe(|/in order ~ following the^traii^ be able to 
make a statement as to^Vbeth^^ ncAj^easured^dat^ndicate an abnormality of the 
2 0 system. After the end of th^trkiti^g^, anjnformation flow (see [1] or [2]) is evaluated 
on the basis of current da^k in a step^3D2rN^An abnormality of the system can be 
indicated on the basis of tbi^nformation flow before^the occurrence of this 
abnormality. Thejim is predicted in a step 303; an action^th^ opposes an 

occurrengj^t the ^normality is implemented in a step 304. Subsequently a branch is 
2 5 D^eferably madeio the step 302. 



TWb applied examples follow, these-illu«trating the possibilities of a 



prediction of an abnormality. 
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Application 1: Electrocardiogram (ECG) Data 

One application relates to the possible prediction of a fibrillatinp4ieart. 
The abnoniialityji s - ccmpTOjO^^^ lli al: the heart beats nearly chaoticany. 

ECG measured data are inventively employed in order to learn the 
dynamics of a heart of a patient (training phase of the neural network NN). 4t should - 
thoroby^o^notod that tho dynamics of the heart vary greatly dep^dent, for example, 
on the time of day and the activity in which a person is engaged *at4b©-moment. 
Invariable quantities (prediction quantity) that significantly^ describe the dynamics of 
the heart oftbe%8FS©n despite great variation-g£oaid=»n(metheless fee- determined. A 
variation of the prediction quantity enables the predkftion of an abnormality of the 
heart, A control mechanism that restores the norpial heart rhythm is started upon 
recognition of the abnormality. 

The prediction quantity represent^ an imaging of a sudden variation of the 
complexity of the dynamics, and the actum)r is realized in the form of an electrode 
that delivers small electrical pulses to the heart. 



Application 2: EJectroencephalQgram.(EEG) Data 

The brain, p re f e r a b iy - thclhuma igte^T is another dynamic system. When it 
is assumed that EEG measured data represent brain activity, one task is to suitably 
interpret the signals and potentially link predetermined measures i^i^^^43fe^^aft 
2 0 epileptic attack is characxerized by a synchronous firing of a group of neurons that are 
arranged centered around a mid-point. This synchronism reduces the complexity of 
the dynamics of the^rain and is indicated by EEG measured data. In contrast ther e to, - 
the normal condmon,4r#^ the normally working brain, represents a condition of 
irregularly firing neurons. 

2 5 The early recognition of an epileptic attack becomes possible by 
determining a continued simphfication of the dynamics of the brain. The actuator for 
restorina4he normal condition has the job of opposing this synchronism that is 
apparently responsible for the epileptic attack. This preferably occurs by applying a 
field,/ks explained in greater depth below. 

3 0 / We-stiall-tem-to-fe second applied example for avoiding an epileptic 
fac k - b o l o w for fiarthef-rc a eh iH g-cemmentsf 3^0*^ 




The Dynamic Prediction Quantity 

The idea is comprised in the expansion of the statistic^approximation 
according to^P]1ror detecting a Markov character in which a^^en empirical time row 



is inherent. One objective is to separate a deterministic partfeffli a stochastic part of a 

in that the information 
flow of the system is analyzed. The statistical development of the dynamics is tested 
against a hierarchy of zero hypotheses that corresfK)nd to non-linear Markov processes 
with increasing order n. These processes are 4ivided into a deterministic part and a 
stochastic part in the following way: 
10 x^ = f(x,.i,.,.,XtJ + u / (IX 

^wh^^ebyu* indicates an additive noise distributed according to Gauss with the variance 
o^, indicates a measured datum atythe time t and fj[^^indicates a deterministic part. 

The Markov process y^th the order n is defined by the conditioned 
probability densities thereof 



i2) . 



15 The deterministic part/is implemented by a neural network NN that is trained 

according to the makimum likelihood principle j3fapplied to the probability densities 
according to Equation (2). The stochastic part u is described by noise distributed 
according to Gauss, wtetebythe variance is referred to a defined, mean lastj^ief 
quadratic ercOr. In other words, the zero hypotheses contain not only the order of the 
2 0 Markov process but also an actual deterministic structure. When a chaotic condition is 
present, mus, the order of the accepted zero hypothesis is the EED (effective 
embedding dimension). This approach opens up a method for determining the EED, 
whereas temporary measured data are modelled parallel A^ete*. 

This approach also allows a strict expansion of the concept of ED 
25 Xkinbedding) when a chaotic condition prevails. The express determination of the 

deterministic part is a method for filtering the no^e out of the time row. ^nkcp/" 
The zero hypothesis is implemented with a method described inj^. 




As known from r>fandj]2^; an information flow, i.e.^a non-parametric 
criterion of a predictable development, is used as a discriminating statistic: A 
significance test is -tfewSrimplemented for every point in time to be predictedj^wb^febt^fik 
the zero hypothesis (i.e.ya given assumption that is to be checked) is/only accepted 
when the significance test is met for 2ill quantities of the point in time to be predicted. 



Analysis of Human Epilepsy Attacks 

As described above, one application of the invention is represented by the 
analysis of EEG measured data in order to prevent an epileptic attack. One goal is 
■ther e by to te st whether a dynamic classification of the measured data for time windows 
10 of different size can be used as prediction quantities in order to predict an epileptic 
attack. In particular, two prediction quantities >6re recited: 

a) The "reminder" of the underlying dynamics, i.e^the EED (see the 
above comments); 

b) a non-parametric criterion for a predictability, defined by the 
15 integration of the/information flow. 

The approach presented here doe/ not assume that the underlying dynamics are chaotic 
(even if they could be); rather, Ae emphasis lies on the time span preceding the 
epileptic attack in order to define a prediction quantity for the epileptic attack that is 
based on the dynamics ofrhe system. 



2 0 Control of the Enileptic Attack 

An epileptic attack can be suppressed in that a constant electrical field is 
supplied to tj{e regions that are affected by the epileptic attack (see 

According to an assumption that the normal condition of the brain is 
marked^by chaotic dynamics, an epileptic attack is expressed by a drastic simplification 
25 of the dynamics in the brain. The epileptic attack is countered in that the reduction of 
the dynamics, i.e.^the synchronicity is, as described above, opposed in that a noise is 
supplied to the system,4fee-bFma-ifrthis^6ase.-^^m y?Va\n j in Q:35P, 




8 

The delivery of this noise is preferably generated by applying an plectrical 
field or a magnetic field in the immediate environment of (as close as possible to) the 
location of the action. Electrodes for generating an electrical field or^o6ils for 
generating a magnetic field are preferably employed for this purpo^e^^ The 
5 synchronously firing neurons in the epileptic attack have their sypfchronicity disturbed 
by the electrical and/or magnetic field; a (seemingly) chaotic firing of the neurons is re- 
established in the brainr^the epileptic attack has thus been a^iferted. 

It is thu&iundamentally important that a suit^tole reaction is carried out in 
response to an abnormal behavior of a dynamic system, w h er eb y the abnormal 

10 behavior is detected with a prediction quantity, •a^endent-ofthe field of employment, 
this reaction^b-cen^rised, for example,-«-genepating a chaoti<f or in generating a 
regular field. This action, which is implemented by the actuator, is dependent on the 
respective field of employment. What the/arious versions of the method respectively 
have in common is a dynamic leaming,^/^^e^!^£^ significant abnormality is allocated 

15 to a prediction quantity and this precifctipn quantity enables a detection of an 

impending abnormality. It is thcnzfe y-expedient-to-implement a suitable action with the 
actuator within a predetermine/ time interval preceding the occurrence of the 
abnormality jfof the epileptio^eizure or of the chaotically beating heart). The 
prediction quantity thus fables the recognition of an abnormality before -this-actually 

2 0 occurs. / 

Since th/ entire system changes over a longer time span in view of its 
dynamically normal property, an adaption of the originally learned dynamic system is 
-e^epedient. It i/important to define the prediction quantity in that the data significantly 
characterizing an abnormality are imaged fi-om the entire dynamic system in the 

25 prediction/quantity. A prediction of the abnormality can thus ensue even given a 

dynamicysystem subject to great fluctuations, for example.a heart that is subjected to 

gr e at est variety of stresses, wh e r-eby one of these stresses does not necessanly 
indicate an abnormality. 



[3 

m 
a 

CO 
id 

= 

C3 
irl 
C3 
CO 
C3 
C3 



10 



The following publications were cited in the framework of this document: 

SCO, C. Schittenkopf and B. Schurmann, "Determining the ipformation 
flow of dynatoic^ systems from continuous probability distfibutions", 
Phys. Rev. Lett. Tg/pages^S/^S, 1997. 

C. Schittenkopf and G. Deco, /Hesto^^i^ji^e hypotheses in 

dynamical systems", Physica BiJ^<p^ges^64;;74, 199^. 
J. Herz, A. Krogh, R. PalmjefT^^Introduction to mfe>:ilieory of neural 
computation", Addi^crfvAVesley, 1991. 

G. Deco, D. Obfadovic, "An Information-Theoretic ApproachlbvNeural 
Computiiig", Springer- Verlag, 1996, Chapter 7.2. 

jluckmann, E. Neel, T. Netoflf, W. Ditto, M. Spano, S. SchiflF, "Electric 
field suppression of epiletiform activity in hippocampal slices", Journal of 
Neurophysiology 76, pages 4202-4205, 1996. 



